Deep Task-Based Quantization
نویسندگان
چکیده
Quantizers play a critical role in digital signal processing systems. Recent works have shown that the performance of acquiring multiple analog signals using scalar analog-to-digital converters (ADCs) can be significantly improved by prior to quantization. However, design such hybrid quantizers is quite complex, and their implementation requires complete knowledge statistical model signal. In this work we data-driven task-oriented quantization systems with ADCs, which determine mapping deep learning tools. These mappings are designed facilitate task recovering underlying information from quantized signals. By learning, circumvent need explicitly recover system find proper rule for it. Our main target application multiple-input multiple-output (MIMO) communication receivers, simultaneously acquire set signals, commonly subject constraints on number bits. results indicate that, MIMO channel estimation setup, proposed task-bask quantizer capable approaching optimal limits dictated indirect rate-distortion theory, achievable vector requiring model. Furthermore, symbol detection scenario, it demonstrated approach realize reliable bit-efficient receivers setting light task.
منابع مشابه
Deep Learning Policy Quantization
We introduce a novel type of actor-critic approach for deep reinforcement learning which is based on learning vector quantization. We replace the softmax operator of the policy with a more general and more flexible operator that is similar to the robust soft learning vector quantization algorithm. We compare our approach to the default A3C architecture on three Atari 2600 games and a simplistic...
متن کاملDeep Model Based Transfer and Multi-Task Learning Deep Model Based Transfer and Multi-Task Learning for Biological Image Analysis
A central theme in learning from image data is to develop appropriate representations for the specific task at hand. Traditional methods used handcrafted local features combined with high-level image representations to generate image-level representations. Thus, a practical challenge is to determine what features are appropriate for specific tasks. For example, in the study of gene expression p...
متن کاملDetection of perturbed quantization (PQ) steganography based on empirical matrix
Perturbed Quantization (PQ) steganography scheme is almost undetectable with the current steganalysis methods. We present a new steganalysis method for detection of this data hiding algorithm. We show that the PQ method distorts the dependencies of DCT coefficient values; especially changes much lower than significant bit planes. For steganalysis of PQ, we propose features extraction from the e...
متن کاملResiliency of Deep Neural Networks under Quantization
The complexity of deep neural network algorithms for hardware implementation can be much lowered by optimizing the word-length of weights and signals. Direct quantization of floating-point weights, however, does not show good performance when the number of bits assigned is small. Retraining of quantized networks has been developed to relieve this problem. In this work, the effects of quantizati...
متن کاملLoss-aware Weight Quantization of Deep Networks
The huge size of deep networks hinders their use in small computing devices. In this paper, we consider compressing the network by weight quantization. We extend a recently proposed loss-aware weight binarization scheme to ternarization, with possibly different scaling parameters for the positive and negative weights, and m-bit (where m > 2) quantization. Experiments on feedforward and recurren...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Entropy
سال: 2021
ISSN: ['1099-4300']
DOI: https://doi.org/10.3390/e23010104